House monitoring system

ABSTRACT

A house monitoring system includes at least one sensor that detects a predetermined event, a master device that communicates with the sensor, and is connected to a fixed telephone network so as to perform calls to other fixed telephones, and a mobile phone terminal that includes a display/input unit, performs wireless communication with the master device by using a wireless router, and is connected to other mobile phones via a mobile phone network. When the sensor detects the predetermined event, the master device transmits information regarding the sensor having detected the predetermined event to the mobile phone terminal, and the mobile phone terminal displays the information regarding the sensor having detected the predetermined event transmitted from the master device on the display/input unit.

BACKGROUND

Technical Field

The present invention relates to a house monitoring system whichmonitors circumstances in a house.

Description of the Related Art

In the related art, as an example of a monitoring system for monitoringthe inside of a house, there is a monitoring camera system which easilyperforms remote monitoring even from a remote location and monitors amonitoring target by using bidirectional communication of video andsound (for example, refer to Japanese Patent Unexamined Publication No.2007-323533).

The monitoring system disclosed in Japanese Patent UnexaminedPublication No. 2007-323533 includes a controller which is a monitoringserver installed at an indoor distribution board in a predeterminedhouse lot (within a house), a first camera unit which is an interphoneslave device installed at an entrance door, a second camera unit whichis installed in a dining room, a third camera unit which is installed ina bedroom, an indoor unit which is an interphone master device installedin a living room, and one or more mobile phones present at remoteplaces. For example, in a case where a dweller is out, when each cameraunit detects an intruder, the controller switches and transmits acaptured video signal and a collected audio signal to the mobile phoneso as to capture the intruder.

BRIEF SUMMARY

However, in the above-described configuration disclosed in JapanesePatent Unexamined Publication No. 2007-323533, since a video signal andan audio signal from each camera unit are appropriately switched andtransmitted to the mobile phone so as to capture motion and sound of theintruder, a configuration of the controller is complex, and thisinevitably leads to an increase in cost, and it is difficult toimplement a monitoring system including the controller at low cost. Inthe above-described configuration disclosed in Japanese PatentUnexamined Publication No. 2007-323533, since detection of an intruderusing a sensor is not taken into consideration, for example, there is aproblem in that it is difficult to highly accurately monitorcircumstances of a house in which a sensor is provided at a locationwhere it is hard for the camera unit provided in the house to capture animage.

In order to solve the above-described problems, an object of the presentinvention is to provide a house monitoring system which realizes highlyaccurate monitoring of circumstances of a house at low cost by notifyinga mobile phone terminal of an installation location of a sensor providedin a house even if a user does not know the installation location, byusing an existing fixed telephone which is connected to a fixedtelephone network and can perform calls to other fixed telephones.

According to the present invention, there is provided a house monitoringsystem including at least one sensor that detects a predetermined event;a master device that communicates with the at least one sensor, and isconnected to a fixed telephone network so as to perform calls to otherfixed telephones; and a mobile phone terminal that includes adisplay/input unit, performs wireless communication with the masterdevice by using a wireless router, and is connected to other mobilephones via a mobile phone network, in which, when the sensor detects thepredetermined event, the master device transmits information regardingthe sensor having detected the predetermined event to the mobile phoneterminal, and in which the mobile phone terminal displays theinformation regarding the sensor having detected the predetermined eventtransmitted from the master device on the display/input unit.

According to the present invention, it is possible to realize highlyaccurate monitoring of circumstances of a house at low cost by notifyinga mobile phone terminal of an installation location of a sensor providedin a house even if a user does not know the installation location, byusing an existing fixed telephone which is connected to a fixedtelephone network and can perform calls to other fixed telephones.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is a diagram illustrating an example of a system configuration ofa house monitoring system of the present embodiment;

FIG. 2 is a block diagram illustrating an example of an internalconfiguration of a master device;

FIG. 3 is a block diagram illustrating an example of an internalconfiguration of a cordless slave device;

FIG. 4 is a block diagram illustrating an example of an internalconfiguration of a camera;

FIG. 5 is a block diagram illustrating an example of an internalconfiguration of a sensor;

FIG. 6 is a block diagram illustrating an example of an internalconfiguration of a smartphone;

FIG. 7 is a sequence diagram illustrating an example of an operationprocedure in which the master device transmits and displays an imagewhich is being recorded by the baby monitoring camera to the smartphonein the house monitoring system of the present embodiment;

FIG. 8A is a diagram illustrating an example of a home screen displayedon the smartphone in which a client application of the house monitoringsystem is installed;

FIG. 8B is a diagram illustrating an example of a specific screen ofsettings (Settings) of the home screen illustrated in FIG. 8A;

FIG. 8C is a diagram illustrating an example of a specific screen ofdevice profiles (Device Profiles) illustrated in FIG. 8B;

FIG. 9A is a diagram illustrating an example of a home screen displayedon the smartphone in which a client application of the house monitoringsystem is installed;

FIG. 9B is a diagram illustrating an example of a specific screen ofsettings (Settings) of the home screen illustrated in FIG. 9A;

FIG. 10A is a diagram illustrating an example of a live monitoringscreen displayed on the smartphone while a baby monitoring cameraperforms recording;

FIG. 10B is a diagram illustrating a first example of alert notificationinformation which is displayed on the live monitoring screen illustratedin FIG. 10A in an interruption manner;

FIG. 10C is a diagram illustrating a second example of alertnotification information which is displayed on the live monitoringscreen illustrated in FIG. 10A in an interruption manner;

FIG. 11 is a diagram illustrating an example of an alert notificationdestination list; and

FIG. 12 is a sequence diagram illustrating an example of an operationprocedure in which alert notification information is displayed on thesmartphone in an interruption manner via the master device in the housemonitoring system of the present embodiment.

DETAILED DESCRIPTION

With reference to the drawings, a description will be made of anembodiment (hereinafter, referred to as “the present embodiment”) of ahouse monitoring system related to the present invention. In thefollowing present embodiment, as an example of a house monitoring systemrelated to the present invention, an exemplary house monitoring systemused for home security will be described. The present invention is notlimited to a house monitoring system, and may be represented as each ofdevices constituting the house monitoring system, a method for eachdevice, and a program.

A house monitoring system of the present embodiment includes at leastone sensor (for example, human sensors 40A and 40B, smoke sensor 40C,and opening/closing sensor 40D which will be described later) thatdetects a predetermined event, a master device that communicates withthe at least one sensor, and is connected to a fixed telephone networkso as to perform calls to other fixed telephones, and a mobile phoneterminal that includes a display/input unit, performs wirelesscommunication with the master device by using a wireless router, and isconnected to other mobile phones via a mobile phone network. When thesensor detects the predetermined event, the master device transmitsinformation regarding the sensor having detected the predetermined eventto the mobile phone terminal. The mobile phone terminal displays theinformation regarding the sensor having detected the predetermined eventtransmitted from the master device on the display/input unit.

FIG. 1 is a diagram illustrating a system configuration of housemonitoring system 5 of the present embodiment. House monitoring system 5is mainly provided in house 8, and includes master device 10, twocordless slave devices 20A and 20B (hereinafter, simply referred to as“slave devices”), a plurality of cameras (specifically, indoor camera30A, monitoring camera 30B, baby monitoring camera 30C, . . . ), varioussensors (specifically, human sensors 40A and 40B, smoke sensor 40C,opening/closing sensor 40D, . . . ), smartphone 50, and wireless router60. A configuration of house monitoring system 5 is only an example andmay be modified in various aspects.

Master device 10 which functions as a gateway in house monitoring system5 is a control device which controls the entire operation of housemonitoring system 5, and is connected to the slave devices, the cameras,the sensors, the smart plugs, and the like in a communicable manner byusing a communication method such as digital enhanced cordlesstelecommunications (DECT). Master device 10 is connected to the Internet65 via wireless router 60 using a wireless LAN. Master device 10 isconnected to fixed telephone network 85 in a wired manner, and canperform a call to, for example, fixed telephone 80 which is designatedas a transmission destination in advance by a user of smartphone 50(hereinafter, simply referred to as a “user”). Master device 10 has afunction of charging slave device 20A which is inserted into insertionport 10 a.

Slave devices 20A and 20B are connected to master device 10 in the DECTcommunication method and can perform a call to master device 10.Particularly, in a case where two slave devices 20A and 20B are notrequired to be differentiated from each other, the slave devices arecollectively referred to as slave device 20.

Various sensors 40 (specifically, human sensors 40A and 40B, smokesensor 40C, opening/closing sensor 40D, . . . ) are connected to masterdevice 10 in the DECT communication method. Herein, as sensors,opening/closing sensor 40D which detects opening and closing of awindow, smoke sensor 40C which detects smoke, and human sensors 40A and40B which detect a person with infrared rays are used. Particularly, ina case where the sensors are not required to be differentiated from eachother, the sensors are collectively referred to as sensor 40. As will bedescribed later, infrared sensor 313 (refer to FIG. 4) built into camera30 is also used as a human sensor.

A plurality of cameras (specifically, indoor camera 30A, monitoringcamera 30B, baby monitoring camera 30C, . . . ) have a call function andare connected to master device 10 in the DECT communication method.Herein, as cameras, monitoring camera 30B which captures an image of anoutdoor environment, indoor camera 30A which captures an image of house8, and baby monitoring camera 30C which captures an image of a sleepinglocation of an infant (for example, a baby bed (not illustrated) or thevicinity thereof), are used. Particularly, in a case where the camerasare not required to be differentiated from each other, the cameras arecollectively referred to as camera 30.

Smartphone 50 is provided as an example of a mobile phone terminal.Smartphone 50 is connected to master device 10 via wireless router 60using a wireless LAN, and is connected to mobile phone 70 or othersmartphones via mobile phone network 75 using a communication methodsuch as the third generation (3G) method, a high speed packet access(HSPA) method, or a long term evolution (LTE) method.

FIG. 2 is a block diagram illustrating an example of an internalconfiguration of master device 10. Master device 10 includes controlunit 109, storage unit 103, operation unit 105, and display unit 106.Master device 10 receives various input operations and displaysinformation such as an image on display unit 106. Control unit 109 hascall control portion 110 and audio stream processing portion 112 builtthereinto, and performs call control during calling, processing of audiodata, and the like.

Master device 10 includes image memory control unit 115 and image memory116, and stores image data or the like captured by camera 30 in imagememory 116.

Master device 10 includes wireless LAN control unit 121 and wireless LANcommunication I/F unit 122, and transmits and receives image data andaudio data to and from smartphone 50, camera 30, and the like viawireless router 60 connected over a wireless LAN.

Master device 10 includes DECT protocol control unit 108 and DECTwireless I/F unit 107, and performs wireless connection to slave device20, sensor 40, and camera 30 by using a wireless method such as digitalenhanced cordless telecommunications (DECT).

Master device 10 includes audio bus 117, sound input/output control unit104, speaker 129, and microphone 128, and performs input and output ofsound to and from an external device.

Master device 10 includes fixed telephone line I/F unit 101, and canperform a call to external fixed telephone 80 (refer to FIG. 1)connected to fixed telephone network 85. It is assumed that fixedtelephone 80 is designated in advance by the user as a transmissiondestination to which the incoming call to master device 10 istransmitted, for example, in a case where there is no person in house 8when there is an incoming call to master device 10.

Master device 10 includes slave device/portable terminal charging unit126 and charges slave device 20 or smartphone 50 inserted into insertionport 10 a.

Master device 10 includes USB communication I/F unit 127, and transmitsand receives data to and from an apparatus, a memory, or the like havingan interface of a universal serial bus (USB) standard.

Master device 10 registers pairs of various sensors 40 and the pluralityof cameras 30 in storage unit 103 in correlation with each other. Forexample, human sensor 40B and monitoring camera 30B are installed atclose locations outdoors and are thus registered in correlation witheach other. Monitoring camera 30B, as will be described later,integrally has infrared sensor 313 (refer to FIG. 4) which is a humansensor and is built thereinto, and is thus also registered incorrelation with infrared sensor 313. Human sensor 40A, smoke sensor40C, and opening/closing sensor 40D are all installed inside house 8 andare thus registered in correlation with either indoor camera 30A or babymonitoring camera 30C.

Master device 10 stores, in storage unit 103, an alarm notificationdestination list (refer to FIG. 11) as a notification destination listin which any one of sensors 40 is correlated with one or morenotification destination devices (for example, cordless slave device 20,and fixed telephone 80) of alert notification information (refer to thefollowing description). FIG. 11 is a diagram illustrating an example ofan alert notification destination list. In FIG. 11, the name of sensor40, identification information (ID) of sensor 40, an installationlocation of sensor 40, and a notification destination device of alertnotification information are correlated with each other for each sensor40. For convenience of description, an ID of sensor 40 and a referencesign used in each sensor are the same as each other.

For example, human sensor 40A1 having identification information (ID)“40A1” is installed at an entrance, and smartphone 50, cordless slavedevice 20, and fixed telephone 80 are registered as notificationdestination devices of alert notification information (which will bedescribed later). In other words, in a case where human sensor 40A1detects a predetermined event (for example, detection of a person),smartphone 50, cordless slave device 20, and fixed telephone 80 arenotified of alert notification information via master device 10.

For example, human sensor 40A2 having identification information (ID)“40A2” is installed in a living room, and smartphone 50 and cordlessslave device 20 are registered as notification destination devices ofalert notification information (which will be described later). In otherwords, in a case where human sensor 40A2 detects a predetermined event(for example, detection of a person), smartphone 50 and cordless slavedevice 20 are notified of alert notification information via masterdevice 10.

For example, human sensor 40A3 having identification information (ID)“40A3” is installed in a bedroom, and smartphone 50 is registered as anotification destination device of alert notification information (whichwill be described later). In other words, in a case where human sensor40A3 detects a predetermined event (for example, detection of a person),smartphone 50 is notified of alert notification information via masterdevice 10.

FIG. 3 is a block diagram illustrating an example of an internalconfiguration of (cordless) slave device 20. Slave device 20 includescontrol unit 247, storage unit 242, operation unit 244, and display unit245. Slave device 20 receives various input operations and displaysinformation such as an image on display unit 245. In a case where anotification of alert notification information is received from masterdevice 10, slave device 20 displays the alert notification informationon display unit 245.

Slave device 20 includes DECT protocol control unit 249 and DECTwireless I/F unit 248, and performs wireless connection to master device10, sensor 40, and camera 30 by using a wireless method such as DECT.

Slave device 20 includes audio bus 255, sound input/output control unit243, speaker 252, and microphone 251, and performs input and output ofsound to and from an external device. In a case where audio data of anotification sound (event detection notification sound) indicating thata predetermined event has been detected by any one of sensors 40 isreceived from master device 10, slave device 20 outputs the audio dataof the event detection notification sound from speaker 252 by apredetermined number of times (for example, three times). Thepredetermined number of times may be specified in advance in slavedevice 20, and may be a number of times for which an instruction isgiven in the audio data of the event detection notification sound frommaster device 10.

Slave device 20 includes secondary battery 250, and, in a case of beingused as a cordless slave device, each unit of slave device 20 issupplied with power from secondary battery 250 so as to perform anoperation.

FIG. 4 is a block diagram illustrating an example of an internalconfiguration of camera 30. Indoor camera 30A, monitoring camera 30B,and baby monitoring camera 30C as examples of cameras 30 havesubstantially the same configuration as each other. Camera 30 includescontrol unit 309, storage unit 303, and operation unit 305. Camera 30performs an operation related to image capturing and also receives inputoperations.

Camera 30 includes DECT protocol control unit 317 and DECT wireless I/Funit 318, and performs wireless connection to master device 10 by usinga wireless method such as DECT.

Camera 30 includes wireless LAN control unit 321 and wireless LANcommunication I/F unit 322, and transmits and receives image data andaudio data to and from master device 10, smartphone 50, and the like viawireless router 60 connected over the wireless LAN.

Camera 30 includes audio bus 307, sound input/output control unit 304,speaker 329, and microphone 328, and performs input and output of soundto and from an external device. For example, camera 30 transmits audiodata collected by microphone 328 to master device 10, and outputs audiodata including selected audio data (for example, call voice of a user ofsmartphone 50) transmitted from master device 10, from speaker 329.

Camera 30 includes image capturing unit 312, image memory control unit316, and image memory 315, and stores image data captured by imagecapturing unit 312 in image memory 315. Image capturing unit 312 has aknown image capturing mechanism and includes at least a lens and animaging element (for example, an image sensor such as a charged coupleddevice (CCD) or a complementary metal oxide semiconductor (CMOS)).

Camera 30 integrally has infrared sensor 313 which is a passive infrared(PIR) sensor as a human sensor built thereinto. Infrared sensor 313detects the presence of a person by detecting a change in heat (infraredray) generated by the person. Camera 30 includes a power source unit 314which is constituted by a commercial AC power source. However, infraredsensor 313 illustrated in FIG. 4 is not provided in baby monitoringcamera 30C illustrated in FIG. 1.

FIG. 5 is a block diagram illustrating an example of an internalconfiguration of sensor 40. Sensor 40 includes control unit 447, storageunit 442, and display lamp 445. Sensor 40 performs a predetermineddetection operation, such as turning on display lamp 445, in a casewhere a predetermined event (for example, detection of a person such asan intruder, which is also the same for the following description unlessparticularly otherwise description is made as description of an event)is detected.

Sensor 40 includes DECT protocol control unit 449 and DECT wireless I/Funit 448, and performs wireless connection to master device 10 by usinga wireless method such as DECT, and transmits a notification (eventdetection notification) indicating that an event has been detected tomaster device 10 when the predetermined event is detected.

Sensor unit 453 differs depending on the kind of sensor 40. For example,in a case of human sensors 40A1, 40A2, 40A3 and 40B, sensor unit 453 isa PIR sensor which detects a person through a change in infrared rays.In a case of opening/closing sensor 40D which detects opening andclosing of a front door, a window, or the like, sensor unit 453 is areed switch which switches between turned-on and turned-off states dueto opening and closing. In a case of smoke sensor 40C, sensor unit 453is a light emitting/receiving unit which detects smoke when emittedlight is blocked by the smoke. Secondary battery 450 is a rechargeablebattery and supplies power to each unit. Sensor unit 453 may be atemperature sensor which can detect an ambient temperature.

FIG. 6 is a block diagram illustrating an example of an internalconfiguration of smartphone 50. Smartphone 50 as a mobile phone terminalincludes control unit 506, storage unit 504, and display/operation unit(for example, touch panel) 503. Smartphone 50 receives various inputoperations and displays information such as an image or alertnotification information (for example, refer to FIG. 10B or FIG. 10C) ondisplay/operation unit 503. A monitoring function control portion 514which can set a function of camera 30 is built into control unit 506 asdescribed later.

Display/operation unit 503, which is a display/input unit into which adisplay unit and an operation unit are integrated, displays informationsuch as an image or an icon on a screen, and receives a tap operation(or a touch operation) on a screen performed by a user.

A client application corresponding to house monitoring system 5 of thepresent embodiment is installed in smartphone 50, and a program and dataof the client application are stored in storage unit 504. Smartphone 50reads and activates the client application from storage unit 504 througha user's input operation.

Smartphone 50 includes 3G protocol control unit 502 and 3G wireless I/Funit 501, and performs wireless connection to mobile phone 70 or othersmartphones connected to mobile phone network 75, by using a thirdgeneration (3G) wireless communication method. Smartphone 50 may includea protocol control unit and a wireless I/F unit corresponding to awireless communication method (for example, HSPA or LTE) other than the3G method.

Smartphone 50 includes audio bus 515, sound input/output control unit505, speaker 513, and microphone 512, and performs input and output ofsound to and from an external device. For example, smartphone 50transmits audio data of a user collected by microphone 512 to masterdevice 10, receives audio data of a call party collected by camera 30(for example, baby monitoring camera 30C) from master device 10, andoutputs the audio data transmitted from master device 10, from speaker329. Consequently, in house monitoring system 5 of the presentembodiment, bidirectional communication can be performed betweensmartphone 50 and camera 30 (for example, baby monitoring camera 30C)via master device 10.

Smartphone 50 includes wireless LAN control unit 507 and wireless LANcommunication I/F unit 508, and transmits and receives image data andaudio data to and from master device 10 or camera 30 via wireless router60 connected over the wireless LAN.

Smartphone 50 includes USB communication I/F unit 511, and transmits andreceives data to and from an apparatus, a memory, or the like having aninterface of a universal serial bus (USB) standard.

Next, with reference to FIG. 7, a description will be made of anoperation of house monitoring system 5 of the present embodiment. FIG. 7is a sequence diagram illustrating an example of an operation procedurein which master device 10 transmits and displays an image which is beingrecorded by baby monitoring camera 30C to smartphone 50 in housemonitoring system 5 of the present embodiment. In FIG. 7, forconvenience of description, baby monitoring camera 30C is used as anexample of camera 30, but other cameras 30 may be used.

In FIG. 7, it is assumed that a home security application correspondingto house monitoring system 5 of the present embodiment is activated insmartphone 50 in advance.

In FIG. 7, if detection information (for example, information regardingan activation operation of the client application for home security,corresponding to house monitoring system 5, performed by the useroperating smartphone 50) for a predetermined trigger operation isacquired (step S1), master device 10 performs a wireless communicationconnection to smartphone 50 by using a wireless LAN (step S2), andtransmits the detection information (refer to the above description) forthe predetermined trigger operation to smartphone 50 when the wirelessLAN connection to smartphone 50 has been completed (step S3).

If an instruction operation of an image/audio data transmission requestis received from the user (step S4), smartphone 50 transmits informationregarding the instruction operation of an image/audio data transmissionrequest (step S5). If the information regarding the instructionoperation is received from smartphone 50, master device 10 requests babymonitoring camera 30C to transmit image/audio data (step S6). Masterdevice 10 may transmit the detection information (refer to the abovedescription) for the predetermined trigger operation to smartphone 50and may also request baby monitoring camera 30C to transmit image/audiodata (step S6).

If the image/audio data transmission request is received from masterdevice 10, baby monitoring camera 30C performs a wireless communicationconnection to master device 10 by using the wireless LAN, and acquiresimage data captured by image capturing unit 312 and audio data collectedby microphone 328 and transmits the data to master device 10 (step S7).Master device 10 transmits the image data and the audio data transmittedfrom baby monitoring camera 30C to smartphone 50 (step S8). Smartphone50 displays the image data transmitted from master device 10 ondisplay/operation unit 503, and outputs the audio data transmitted frommaster device 10 from speaker 513. Consequently, smartphone 50 candisplay a live monitoring screen illustrated in FIG. 10A (step S9).

Next, a description will be made of examples of various screensdisplayed on smartphone 50 with reference to FIGS. 8A to 8C, 9A and 9B,and 10A to 10C. A home screen illustrated in FIG. 8A is the same as ahome screen illustrated in FIG. 9A, and thus description thereof willnot be repeated.

First, with reference to FIG. 8A, a description will be made of a homescreen of the client application activated in smartphone 50. FIG. 8A isa diagram illustrating an example of a home screen displayed onsmartphone 50 in which the client application of house monitoring system5 is installed.

In the home screen illustrated in FIG. 8A, icons respectively indicatinga camera (Camera), a sensor (Sensor), a smart plug (Plug), a smartphone(Phone), home control (Smart Control), and settings (Settings) aredisplayed on display/operation unit 503 of smartphone 50. If the userperforms a tap operation on the icon indicating the settings (Settings)with a finger FG, smartphone 50 displays a specific screen of thesettings (Settings), illustrated in FIG. 8B, on display/operation unit503. FIG. 8B is a diagram illustrating an example of the specific screenof the settings (Settings) of the home screen illustrated in FIG. 8A.Setting menus regarding a plurality of items are displayed on thespecific screen of the settings (Settings) illustrated in FIG. 8B.

For example, if the user performs a tap operation on the setting menu ofdevice profiles (Device Profiles) with finger FG among the settingmenus, smartphone 50 displays a specific screen of the device profiles(Device Profiles), illustrated in FIG. 8C, on display/operation unit503. A frame FR1 indicating that the tap operation is performed isinstantaneously displayed in the device profiles (Device Profiles) whichis a setting menu which is tapped with finger FG. FIG. 8C is a diagramillustrating an example of a specific screen of the device profiles(Device Profiles) illustrated in FIG. 8B. Herein, for convenience ofdescription, it is assumed that the screen illustrated in FIG. 8C isdisplayed in a case where sensor 40 is designated as a device.

An input reception region of an installation location (Location) of adevice (that is, sensor 40), an input reception region of a name (Name)of sensor 40, and a selection indication region indicating whethersensor 40 is a “window opening and closing sensor” or a “door openingand closing sensor”, are displayed on the specific screen of deviceprofiles (Device Profiles) illustrated in FIG. 8C. In FIG. 8C, in a casewhere none is input to the input reception region of an installationlocation of sensor 40, “Not Assigned” is displayed. In a case wheresensor 40 is selected as a “window opening and closing sensor”, atemporary name such as “Window 1” is displayed in the input receptionregion of the name (Name) of sensor 40. The installation location(Location) or the name (Name) of sensor 40 can be changed as appropriatethrough an input operation using finger FG of the user.

For example, in a case where appropriate installation location and nameare input to the installation location (Location) or the name (Name) ofsensor 40, either “Window (window)” or “Door (entrance)” is selected asa type of sensor 40, and an OK button is tapped, smartphone 50 completessetting of profiles of a device (sensor 40) through an operation usingfinger FG of the user. Such device profiles are preferably set inadvance before an operation (refer to FIG. 12) of house monitoringsystem 5 of the present embodiment is performed.

Next, a description will be made of setting of a notificationdestination device of alert notification information with reference toFIGS. 9A and 9B. FIG. 9A is a diagram illustrating an example of a homescreen displayed on smartphone 50 in which the client application ofhouse monitoring system 5 is installed. FIG. 9B is a diagramillustrating an example of a specific screen of settings (Settings) ofthe home screen illustrated in FIG. 9A.

For example, if the user performs a tap operation on the setting menu ofnotification destination device settings (Notification Settings) withfinger FG among the setting menus (refer to FIG. 9B), smartphone 50displays a setting screen (not illustrated) for setting a notificationdestination device of alert notification information for each sensor 40,on display/operation unit 503. A frame FR2 indicating that the tapoperation is performed is instantaneously displayed in the notificationdestination device settings (Notification Settings) which is a settingmenu which is tapped with finger FG. A notification destination devicewhich is a notification destination of alert information is set for eachsensor 40 through setting using the setting screen (refer to FIG. 11).

Next, with reference to FIG. 10A, a description will be made of a livemonitoring screen on which real-time image data captured by camera 30(for example, baby monitoring camera 30C) is displayed in smartphone 50.FIG. 10A is a diagram illustrating an example of a live monitoringscreen displayed on smartphone 50 during recording performed by babymonitoring camera 30C.

Display/operation unit 503 of smartphone 50 illustrated in FIG. 10Adisplays real-time image (or a video) MV1 recorded by baby monitoringcamera 30C, and also displays the name NM1 (for example, baby monitoringcamera 30C) of camera 30 which is mainly used to capture an image.Display/operation unit 503 of smartphone 50 may also display informationregarding a temperature detected by sensor 40 which forms a pair withcamera 30 which is mainly used to capture an image. Display/operationunit 503 of smartphone 50 displays Photo icon IC1, Video icon IC2, Voiceicon IC3, and Lullaby icon IC4 so as to be selectable.

Photo icon IC1, Video icon IC2, Voice icon IC3, and Lullaby icon IC4 arerespectively menu icons which are disposed in advance in order toperform various settings corresponding to a still image (Photo), amoving image (Video), sound (Voice such as call voice), and sound source(Lullaby). For example, Photo icon IC1 is an icon which is used to givean instruction for starting recording in camera 30 and to set a functionof an image recorded by camera 30. Video icon IC2 is an icon which isused to give an instruction for starting recording in camera 30 and toset a function of an image recorded by camera 30. Voice icon IC3 is anicon which is used to give an instruction for starting bidirectionalcalls to camera 30 and to set a function of bidirectional calls tocamera 30.

In a case where camera 30 (for example, baby monitoring camera 30C) doesnot output (reproduce) audio data of a lullaby sound source, whenLullaby icon IC4 is tapped, smartphone 50 displays a lullaby soundsource selection screen (not illustrated) on display/operation unit 503and receives a selection operation of one lullaby sound source from theuser.

Next, a description will be made of a specific example of alertnotification information which is displayed on the live monitoringscreen illustrated in FIG. 10A in an interruption manner, with referenceto FIGS. 10B and 10C. FIG. 10B is a diagram illustrating a first exampleof alert notification information which is displayed on the livemonitoring screen illustrated in FIG. 10A in an interruption manner.FIG. 10C is a diagram illustrating a second example of alertnotification information which is displayed on the live monitoringscreen illustrated in FIG. 10A in an interruption manner.

FIG. 10B illustrates an example in which sensor 40 whose type isselected as “Window (window)” in FIG. 8C detects a predetermined event(for example, opening or closing of a window), alert notificationinformation is displayed on display/operation unit 503 of smartphone 50.A sensor icon IC5 a in which a corresponding sensor 40 (that is, asensor whose type is selected as “Window (window)”) can be visuallyrecognized by the user, and stop icon IC6 a for stopping the display ofthe alert notification information illustrated in FIG. 10B, aredisplayed on the screen example of the alert notification informationillustrated in FIG. 10B. An installation location and a name of thecorresponding sensor 40 are displayed as text on the upper part ofsensor icon IC5 a. In a case where a tap operation is performed on stopicon IC6 a, smartphone 50 displays the live monitoring screen (refer toFIG. 10A) which is displayed right before the alert notificationinformation illustrated in FIG. 10B is displayed, in an interruptionmanner on display/operation unit 503.

In a case where a tap operation is performed on sensor icon IC5 a byusing finger FG of the user, smartphone 50 requests master device 10 totransmit image data captured and audio data collected by camera 30 (forexample, indoor camera 30A) which is correlated so as to form a pairwith sensor 40 corresponding to sensor icon IC5 a (refer to FIG. 12).

Similarly, FIG. 10C illustrates an example in which sensor 40 whose typeis selected as “Door (entrance)” in FIG. 8C detects a predeterminedevent (for example, opening or closing of an entrance), alertnotification information is displayed on display/operation unit 503 ofsmartphone 50. A sensor icon IC5 b in which a corresponding sensor 40(that is, a sensor whose type is selected as “Door (entrance)”) can bevisually recognized by the user, and a stop icon IC6 b for stopping thedisplay of the alert notification information illustrated in FIG. 10C,are displayed on the screen example of the alert notificationinformation illustrated in FIG. 10C. An installation location and a nameof the corresponding sensor 40 are displayed as text on the upper partof sensor icon IC5 b. In a case where a tap operation is performed onstop icon IC6 b, smartphone 50 displays the live monitoring screen(refer to FIG. 10A) which is displayed right before the alertnotification information illustrated in FIG. 10C is displayed, in aninterruption manner on display/operation unit 503.

In a case where a tap operation is performed on sensor icon IC5 b byusing finger FG of the user, smartphone 50 requests master device 10 totransmit image data captured and audio data collected by camera 30 (forexample, monitoring camera 30B) which is correlated so as to form a pairwith sensor 40 corresponding to sensor icon IC5 b (refer to FIG. 12).

Next, with reference to FIG. 12, a description will be made of settingof an alert notification destination list, and interruption display ofalert notification information in a case where sensor 40 detects apredetermined event, in house monitoring system 5 of the presentembodiment. FIG. 12 is a sequence diagram illustrating an example of anoperation procedure in which alert notification information is displayedon smartphone 50 in an interruption manner via master device 10 in housemonitoring system 5 of the present embodiment. As the premise ofdescription of FIG. 12, indoor camera 30A captures an image in an imagecapturing range of indoor camera 30A and collects sound in the imagecapturing range (step S0).

In FIG. 12, the description will be made by using human sensor 40A1provided at the entrance, human sensor 40A2 provided at the living room,and human sensor 40A3 provided at the bed room as examples of aplurality of sensors 40 in house 8.

In FIG. 12, if the user performs an operation (for example, a tapoperation on the setting menu of “Notification Settings” illustrated inFIG. 9B) of giving an instruction for setting a notification destinationdevice of alert notification information in a state (step S9) in whichthe live monitoring screen illustrated in FIG. 10A is displayed ondisplay/operation unit 503 of smartphone 50, smartphone 50 displays asetting screen (not illustrated) of a notification destination device ofalert information on display/operation unit 503. If the user enterssetting information of a notification destination device of alertnotification information to the setting screen displayed on smartphone50 for each sensor 40 (step S11), smartphone 50 transmits the settinginformation of a notification destination device of alert notificationinformation to master device 10 (step S12).

If the setting information of a notification destination device of alertnotification information is received from smartphone 50, master device10 generates an alert notification destination list illustrated in FIG.11 for each sensor 40 (step S13).

Here, if human sensor 40A2 provided at the living room detects apredetermined event (for example, the presence of a person such as anintruder) (step S14), human sensor 40A2 transmits an event detectionnotification to master device 10 in the DECT method (step S15).

If the event detection notification is received from human sensor 40A2,master device 10 generates alert notification information for informingthe user of the fact that the event has been detected by human sensor40A2 (step S16). Master device 10 transmits the alert notificationinformation generated in step S16 to smartphone 50 of the notificationdestination devices (that is, smartphone 50 and cordless slave device20) corresponding to human sensor 40A2 on the basis of the alertnotification destination list (refer to FIG. 11) generated in step S13(step S17).

Smartphone 50 displays the alert notification information transmittedfrom the master device 10 on display/operation unit 503 in aninterruption manner (step S18). In other words, image data transmittedfrom any one of cameras 30 via master device 10 is displayed ondisplay/operation unit 503 as the live monitoring screen in step S9, butthe alert notification information (refer to FIG. 10B or FIG. 10C) isdisplayed preferentially to the image data from any one of cameras 30.Consequently, the user can easily check the fact that any one of sensors40 has detected a predetermined event on display/operation unit 503 ofsmartphone 50.

After step S16, master device 10 performs a text to speech (TTS) processwhich is a well-known technique, and thus generates a notification sound(alert notification sound) corresponding to text (for example, “thehuman sensor of the living room has detected”) of content indicated bythe alert notification information generated in step S16 (step S19).Master device 10 transmits the alert notification sound generated instep S19 to cordless slave device 20 of the notification destinationdevices (that is, smartphone 50 and cordless slave device 20)corresponding to human sensor 40A2 by a predetermined number of times(for example, three times) on the basis of the alert notificationdestination list (refer to FIG. 11) generated in step S13 (step S20).After step S20, master device 10 transmits an instruction for bellringing indicating an end of transmission of the alert notificationsound to cordless slave device 20 (step S22).

Cordless slave device 20 outputs the alert notification soundtransmitted from master device 10 by a predetermined number of timesfrom speaker 252 (step S21), and outputs a predetermined bell sound fromspeaker 252 in response to the instruction for bell ringing transmittedfrom master device 10 in step S22 after step S21 (step S23).

If the alert notification information displayed on display/operationunit 503 of smartphone 50 is tapped with finger FG of the user (stepS24), smartphone 50 transmits operation information indicating that thealert notification information is tapped to master device 10 (step S25).

If the operation information is received from smartphone 50, masterdevice 10 transmits a transmission request of image data and audio datato camera 30 (for example, indoor camera 30A) which is correlated so asto form a pair with sensor 40 (that is, human sensor 40A2 provided atthe living room in FIG. 12) indicated by the alert notificationinformation (step S26). Indoor camera 30A transmits audio data collectedby microphone 328 and image data obtained by image capturing unit 312 tomaster device 10 in response to the transmission request from masterdevice 10 (step S27). Master device 10 transmits the image data and theaudio data transmitted from indoor camera 30A to smartphone 50 (stepS28). If the image data and the audio data transmitted from masterdevice 10 is received, smartphone 50 displays the image data ondisplay/operation unit 503 and outputs the audio data from speaker 513(step S29).

As mentioned above, in house monitoring system 5 of the presentembodiment, if at least one of sensors 40 (for example, human sensors40A and 40B, smoke sensor 40C, and opening/closing sensor 40D) detects apredetermined event (for example, person detection, smoke detection, andwindow opening/closing detection), master device 10 which cancommunicate with at least one sensor 40 transmits information (forexample, alert notification information) regarding sensor 40 which hasdetected the predetermined event to smartphone 50. Smartphone 50displays the information (for example, alert notification information)regarding sensor 40 which has detected the predetermined eventtransmitted from master device 10 on display/operation unit 503.

Consequently, house monitoring system 5 realizes highly accuratemonitoring of circumstances of house 8 at low cost by notifyingsmartphone 50 of an installation location of sensor 40 provided in house8 even if a user of smartphone 50 does not know the installationlocation, by using master device 10 which is an existing fixed telephoneconnected to fixed telephone network 85 and can perform calls to anotherfixed telephone 80. In other words, in a security system of a househaving a plurality of sensors 40, a user (for example, a dweller) canrapidly understand which sensor 40 has performed detection.Consequently, the user can instantly move to the installation locationof sensor 40 having performed detection and can take an appropriateaction such as checking the spot, or the user may be made to be awayfrom the installation location of sensor 40 having performed detection.In this case, the user can avoid a danger or the like given from anintruder of house 8.

In house monitoring system 5 of the present embodiment, one or morenotification destination devices (for example, cordless slave device 20and fixed telephone 80) which can perform a call to master device 10 areprovided. Master device 10 stores an alert notification destination listin which sensor 40 is correlated with one or more notificationdestination devices in storage unit 103, and transmits an eventdetection notification sound (alert notification sound) indicating thata predetermined event has been detected to the one or more notificationdestination devices corresponding to sensor 40 by a predetermined numberof times. Cordless slave device 20 or fixed telephone 80 which is anotification destination device outputs the event detection notificationsound (alert notification sound) transmitted from master device 10 bythe predetermined number of times.

Consequently, in a case where the user does not carry smartphone 50although the user does not stay in house 8, the user can rapidlyunderstand which sensor 40 has performed detection with cordless slavedevice 20 disposed near the user, or even in a case where the user isout, leaving smartphone 50 in house 8, the user can rapidly understandwhich sensor 40 has performed detection with fixed telephone 80 which isdesignated in advance as a transmission destination.

In house monitoring system 5 of the present embodiment, at least onecamera 30 (for example, indoor camera 30A, monitoring camera 30B, andbaby monitoring camera 30C) having an image capturing unit is furtherprovided. Camera 30 transmits image data obtained by image capturingunit 312 to master device 10, and master device 10 transmits the imagedata transmitted from camera 30 to smartphone 50 in response to anoperation (that is, an operation of requesting transmission of the imagedata) on display/operation unit 503 of smartphone 50. Smartphone 50displays the image data transmitted from master device 10 ondisplay/operation unit 503. If sensor 40 detects a predetermined event,master device 10 transmits an interruption display instruction ofinformation regarding sensor 40 which has detected the predeterminedevent to smartphone 50. Smartphone 50 preferentially displays theinformation regarding sensor 40 which has detected the predeterminedevent on display/operation unit 503 in response to the interruptiondisplay instruction transmitted from master device 10.

Consequently, in house monitoring system 5, in a case where any one ofsensors 40 performs detection in house 8 while viewing image datacaptured by camera 30 is viewed on smartphone 50, alert notificationinformation including information regarding sensor 40 having performeddetection in house 8 can be displayed on smartphone 50 preferentially tothe image data. Therefore, the user can immediately understand theoccurrence of a certain event in house 8 by displaying informationregarding sensor 40 having performed detection in house 8 on smartphone50 preferentially to the image data which is previously displayed.

In house monitoring system 5 of the present embodiment, in response toan operation (that is, a tap operation on sensor icon IC5 a or sensoricon IC5 b) on information (alert notification information) regardingsensor 40 displayed on display/operation unit 503, master device 10requests any one of cameras 30 (for example, indoor camera 30A)correlated with sensor 40, which is a target of the operation, totransmit image data. Camera 30 (for example, indoor camera 30A)transmits image data obtained by image capturing unit 312 to masterdevice 10 in response to the image data transmission request from masterdevice 10, and master device 10 transmits the image data transmittedfrom camera 30 to smartphone 50. Smartphone 50 changes the informationregarding sensor 40 which has detected a predetermined event, anddisplays the image data transmitted from master device 10 ondisplay/operation unit 503.

Consequently, in house monitoring system 5, even if a user does not stayin house 8, a simple input operation is performed on smartphone 50 inrelation to information regarding sensor 40 having performed detectionin house 8, and thus display of a screen is switched to image datacaptured by camera 30 (for example, indoor camera 30A) correlated withsensor 40 having performed detection in house 8 and is displayed onsmartphone 50. Therefore, the user can rapidly check circumstances ofhouse 8.

Although the various embodiments have been described with reference tothe drawings, needless to say, the present invention is not limited tosuch embodiments. It is obvious that a person skilled in the art canconceive of various modifications or alterations within the scoperecited in the claims, and thus it is understood that they naturallyfall within the technical scope of the present invention.

In addition, in FIG. 12, a description has been made of an example inwhich human sensor 40A2 provided at the living room detects apredetermined event, but, for example, in a case where human sensor 40A1provided at the entrance detects a predetermined event, master device 10may transmit alert notification sound not only to cordless slave device20 but also to fixed telephone 80 which is a transmission destinationtelephone by a predetermined number of times (for example, three times)and may cause fixed telephone 80 to output the alert notification sound.

What is claimed is:
 1. A home monitoring system comprising: at least onesensor coupled to a DECT (Digital Enhanced Cordless Telecommunications)compliant communicator and configured to detect a defined event; a DECTmaster device that, in operation, performs wireless communication withthe at last one sensor according to a DECT communications protocol,performs wireless communication with one or more DECT cordless handsetsaccording to the DECT communications protocol, and is connected to afixed telephone network to communicate with other fixed telephones; andat least one camera including an imager and a communicator, which, inoperation, transmits image data captured by the imager to the DECTmaster device, wherein the DECT master device, when receiving adetection signal from the at least one sensor having detected thedefined event, transmits information regarding the at least one sensor,via a wireless LAN router, to a smartphone to display the informationregarding the at least one sensor on the smartphone, wherein thesmartphone is connectable to a mobile phone network to communicate withother mobile telephones, the DECT master device, when receiving, via thewireless LAN router, signal indicative of a first operation on thesmartphone, forwards the image data received from the at least onecamera to the smartphone for display on the smartphone, and the DECTmaster device, when receiving the detection signal from the at least onesensor having detected the defined event, transmits a display interruptinstruction via the wireless LAN router to the smartphone to display theinformation regarding the at least one sensor with a higher priorityover the image data from the at least one camera.
 2. The home monitoringsystem of claim 1, which comprises at least one notification destinationdevice communicable with the DECT master device, wherein the DECT masterdevice includes a storage configured to store a notification destinationlist, in which the at least one sensor is correlated with the at leastone notification destination device, the DECT master device, inoperation, transmits an event detection notification audio indicative ofthat the at least one sensor has detected the defined event, a definednumber of times, to the at least one notification destination devicethat is correlated with the at least one sensor having detected thedefined event, and the at least one notification destination deviceoutputs the event detection notification audio the defined number oftimes.
 3. The home monitoring system of claim 2, wherein the at leastone notification destination device is a DECT cordless handset.
 4. Thehome monitoring system of claim 1, wherein the communicator of the atleast one camera is a DECT compliant communicator.
 5. The homemonitoring system of claim 1, wherein the DECT master device, whenreceiving, via the wireless LAN router, signal indicative of a secondoperation to update the information regarding the at least one sensor asdisplayed on the smartphone, transmits an image request to the at leastone camera associated with the at least one sensor having detected thedefined event, and the at least one camera, in response to the imagerequest from the DECT master device, transmits the image data capturedby the imager to the DECT master device, and the DECT master device, inoperation, forwards the image data received from the at least one camerato the smartphone for display on the smartphone.
 6. The home monitoringsystem of claim 5, wherein the first operation on the smartphone is atap operation on the smartphone, and the second operation is a tapoperation on the information regarding the at least one sensor asdisplayed on the smartphone.
 7. The home monitoring system of claim 1,wherein the at least one sensor is an infrared sensor.
 8. The homemonitoring system of claim 1, wherein the at least one sensor isselected from a group consisting of a human sensor, a smoke sensor, anopening/closing sensor, a temperature sensor, and a smart plug.
 9. Thehome monitoring system of claim 1, wherein the at least one sensor is anopening/closing sensor coupled to a window or door, the defined event isopening of the window or door, and the information regarding the atleast one sensor displayed on the smartphone is a name or location ofthe opened window or door as detected by the opening/closing sensor. 10.The home monitoring system of claim 1, wherein the at least one sensoris a smoke sensor, the defined event is detection of smoke, and theinformation regarding the at least one sensor displayed on thesmartphone is a name or location of the smoke sensor.
 11. The homemonitoring system of claim 1, which comprises a plurality of sensorsconfigured to defect a plurality of defined events, respectively, and tocommunicate with the DECT master device according to the DECTcommunication protocol, wherein the DECT master device, when receiving aplurality of detection signals from the plurality of sensors havingdetected the plurality of defined events, respectively, transmits pluralpieces of information regarding the plurality of sensors, via thewireless LAN router, to the smartphone to display the plural pieces ofinformation regarding the plurality of sensors on the smartphone.
 12. Ahome monitoring method based on a home monitoring system, the homemonitoring system comprising: (a) at least one sensor coupled to a DECT(Digital Enhanced Cordless Telecommunications) compliant communicatorand configured to detect a defined event; (b) a DECT master device that,in operation, performs wireless communication with the at last onesensor according to a DECT communications protocol, performs wirelesscommunication with one or more DECT cordless handsets according to theDECT communications protocol, and is connected to a fixed telephonenetwork to communicate with other fixed telephones; and (c) at least onecamera including an imager, the home monitoring method comprising:receiving, at the DECT master device, a detection signal from the atleast one sensor having detected the defined event, transmitting, fromthe DECT master device that has received the detection signal,information regarding the at least one sensor, via a wireless LANrouter, to a smartphone to display the information regarding the atleast one sensor on the smartphone, wherein the smartphone isconnectable to a mobile phone network to communicate with other mobiletelephones; receiving, at the DECT master device, image data captured bythe imager from the at least one camera; forwarding, from the DECTmaster device that has received, via the wireless LAN router, signalindicative of a first operation on the smartphone, the image datareceived from the at least one camera to the smartphone for display onthe smartphone, and transmitting, from the DECT master device that hasreceived the detection signal from the at least one sensor havingdetected the defined event, a display interrupt instruction via thewireless LAN router to the smartphone to display the informationregarding the at least one sensor with a higher priority over the imagedata from the at least one camera.
 13. The home monitoring method ofclaim 12, wherein the home monitoring system comprises at least onenotification destination device communicable with the DECT masterdevice, and the DECT master device includes a storage configured tostore a notification destination list, in which the at least one sensoris correlated with the at least one notification destination device, thehome monitoring method further comprising: transmitting, from the DECTmaster device, an event detection notification audio indicative of thatthe at least one sensor has detected the defined event, a defined numberof times, to the at least one notification destination device that iscorrelated with the at least one sensor having detected the definedevent, and outputting, from the at least one notification destinationdevice, the event detection notification audio the defined number oftimes.
 14. The home monitoring method of claim 13, wherein the at leastone notification destination device is a DECT cordless handset.
 15. Thehome monitoring method of claim 12, wherein the at least one cameraincludes a DECT compliant communicator.
 16. The home monitoring methodof claim 12, further comprising: receiving, at the DECT master devicevia the wireless LAN router, signal indicative of a second operation toupdate the information regarding the at least one sensor as displayed onthe smartphone, transmitting, from the DECT master device that hasreceived the signal indicative of the second operation, an image requestto the at least one camera associated with the at least one sensorhaving detected the defined event, transmitting, from the at least onecamera that has received the image request, the image data captured bythe imager to the DECT master device, and forwarding, from the DECTmaster device, the image data received from the at least one camera tothe smartphone for display on the smartphone.
 17. The home monitoringmethod of claim 16 wherein the first operation on the smartphone is atap operation on the smartphone, and the second operation is a tapoperation on the information regarding the at least one sensor asdisplayed on the smartphone.
 18. The home monitoring method of claim 12,wherein the at least one sensor is an opening/closing sensor coupled toa window or door, the defined event is opening of the window or door,and the information regarding the at least one sensor displayed on thesmartphone is a name or location of the opened window or door asdetected by the opening/closing sensor.
 19. The home monitoring methodof claim 12, wherein the at least one sensor is a smoke sensor, thedefined event is detection of smoke, and the information regarding theat least one sensor displayed on the smartphone is a name or location ofthe smoke sensor.
 20. The home monitoring method of claim 12, whereinthe home monitoring system comprises a plurality of sensors configuredto defect a plurality of defined events, respectively, and tocommunicate with the DECT master device according to the DECTcommunication protocol, the home monitoring method comprising:receiving, at the DECT master device, a plurality of detection signalsfrom the plurality of sensors having detected the plurality of definedevents, respectively, and transmitting, from the DECT master device thathas received the plurality of detection signals, plural pieces ofinformation regarding the plurality of sensors, via the wireless LANrouter, to the smartphone to display the plural pieces of informationregarding the plurality of sensors on the smartphone.